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(54) METHOD FOR FOLLOWING AND IMAGING A SUBJECTS THREE-DIMENSIONAL POSITION 
AND ORIENTATION, METHOD FOR PRESENTING A VIRTUAL SPACE TO A SUBJECT, AND 
SYSTEMS FOR IMPLEMENTING SAID METHODS 



(57) The invention relates to methods and systems 
for determining a user's position and orientation in 
space and for displaying virtual environment, and is 
applicable to interactive computer games, training sys- 
tems of sportive, hearth improving or military designa- 
tion. The invention increases accuracy and speed of 
tracking the user's position and orientation in space, 
provides for convenient and natural movements of the 
user and presents virtual environment in response to 
the user's movements in real environment. Sensors 4 
for tracking an angular position of a user's locomotor 
system segment 2 are arranged proximate junctions 3 
between the segments 2 and on some of the segments 
2. Main reference direction determining means 5 is dis- 
posed on at least one of the segments 2 to determine 
an orientation of the segment with respect to reference 
directions. Information from the sensors 5, reference 
direction determining means 5 and, if appropriate, from 
means 8 for user's interaction with virtual environment 
objects is processed to determine a position and orien- 
tation in space of the user in general on the basis of val- 
ues of angles between segments and the orientation of 
the main segment on which the reference direction 
determining means is located with respect to reference 
directions. The obtained data is employed to display the 
user's movements in real time or to present virtual envi- 
ronment to the user in accordance with his or her field of 



view changing in response to movements in real envi- 
ronment. 
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Description 

Field of the Invention 

[0001] The present invention relates to systems for 
determining user's position and orientation in space and 
is applicable to interactive computer games and training 
systems of sportive or military designation. The inven- 
tion may be employed for improving health, in teaching 
and practicing correct performance of exercises and 
methods in sport games and dances by children and 
adults. 

Background of the Invention 

[0002] Conventional systems for tracking and display- 
ing a human body position in the course of movement 
employ mechanical means for tracking the position of a 
head and body parts, known as goniometers, which are 
designed to measure rotation angles of joints and to 
determine final positions, e.g. of a hand relative to a 
body, or a finger tip relative to a hand. 
[0003] The problem with the conventional systems is 
that it is difficult to position the goniometers relative to 
joints, in particular, to those having a plurality of degrees 
of freedom, such as a hand joint, as goniometer rotation 
centers fail to match the centers of rotation of the joints. 
Human joints are not ideal hinge joints: the rotation axes 
displace changes in angles of joint rotation. To improve 
accuracy, an appropriate calibration must be employed. 
[0004] Described by Burdea G., Coiffer P. in the refer- 
ence titled as Virtual Reality Technology, 1994, John 
Wiley & Sons, Inc., pp.17-25, are magnetic systems of 
tracking and displaying a user's position and orientation 
in space. The systems include Motion Capture Server 
from Polhemius, and Flock of Birds from Ascention 
Technology Corp., which comprise a plurality of circuit 
boards for processing measured movement parame- 
ters, a controller, an external timing circuit board, a com- 
munication circuit board, a keyboard and a monitor, a 
transmitter including three electromagnetic coils and a 
plurality of receivers, each also having a miniature triad 
of electromagnetic coils to detect magnetic fields emit- 
ted by the transmitter. 

[0005] Such systems is small in range, and their accu- 
racy is a function of a distance between the transmitter 
and the receiver. In a system with ac magnetic fields, 
the presence of foreign metal objects impairs the accu- 
racy due to induced eddy currents. A system with dc 
magnetic fields is less sensitive to the presence of for- 
eign metal objects, however, the magnetic resistance 
effect can interfere with the magnetic fields generated 
by the transmitter. 

[0006] The systems also suffer insufficient speed 
caused by time delays in establishing an analogue sig- 
nal and the high noise level which gives rise to picture 
dancing on a screen. 

[0007] Another conventional system is an ultrasonic 



system for tracking a user's position and orientation in 
space, comprising a transmitter including a set of three 
transmitting electroacoustic transducers fixed on a sup- 
porting frame, receivers including sets of three micro- 

5 phones fixed on a supporting frame which is located on 
the user, for example, on a helmet with a display, a sys- 
tem for processing detected information and a system 
for displaying a synthesized image of the user (ibid, 
pp.25-28). The user is located using the triangulation 

10 principle, and nine distance measurements are required 
to determine the user's position and orientation. The 
system necessitates a direct line-of-sight between the 
system transmitter and receivers. When it is necessary 
to track a great number of receivers, the poll frequency 

75 decreases, i.e. the speed of taking measurements 
which are required to provide a real-time representation 
of a moving object or parts thereof is reduced. 
[0008] The above discussed conventional systems 
relate to systems comprising absolute movement 

20 parameter sensors which measure a moveable object 
absolute position and orientation relative to a fixed coor- 
dinate system coupled to a transmitter. 
[0009] The systems also exist which comprise a rela- 
tive motion parameter sensor. The merits of these sys- 

25 terns are their straightforwardness and compactness. 
As an example of such systems mention may be made 
of "gloves" used in virtual reality immersion systems 
comprising sensors for measuring some or all of the 
angles of rotation of finger joints. Such systems may fur- 

30 ther include an absolute three-dimensional movement 
and orientation sensor (a 3D sensor) for tracking the 
user's wrist movements. For instance, a Data Glove 
system with optical sensors from VPL (ibid, pp.33-37) 
comprises optical fibers disposed on a light-weight elas- 

35 tic glove, and a 3D sensor. A standard configuration 
includes a pair of sensors attached to the external part 
of each finger to sense a bend in basic joints. The opti- 
cal fibers are coupled to an optoelectronic interlace. 
The sensor is designed so that in the case of zero bend 

40 in a joint, the light propagating through the fiber is not 
attenuated and, vise versa, a bend changes its amount 
which allows the indirect measurement of the joint rota- 
tion angle. Measurement data are translated into angle 
values using calibration constants and appropriate 

45 approximation equations. The problem with such sys- 
tems is their inferior accuracy caused by errors accumu- 
lated under an open kinematic chain condition, and also 
their high cost. 

[0010] Described in US Patent No. 5490784, US CI. 

so 434-55, IntCI. G 09 B 9/00, published on February 13, 
1996, is a system for presenting virtual reality to a user, 
comprising a moveable platform assembly in the form of 
a spherical capsule with six degrees of freedom, inside 
of which the user is located, means for sensing a spher- 

55 ical platform position and a computer disposed in the 
interior of said capsule. A transmitter sends a platform 
position information to a receiver which, in turn, applies 
the received spherical platform angular position data to 
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a host computer located outside the platform. Provided 
to the host computer is a turning platform linear dis- 
placement information. A helmet-mounted display 
adjusts a virtual reality image based on the received 
platform displacement information. 5 
[0011] The conventional system, however, has a 
sophisticated structure, while the adequacy extent of 
virtual environment simulation is insufficient. 
[0012] US Patent No. 534951 7. CI. 395-129, Int. CI. G 
06 F 15/20, published on October 14, 1992, describes a 10 
system for presenting a composite image of a real and 
virtual environment to a user, the system comprising vir- 
tual display means for presenting the composite image 
to the user; direction sensor means for producing a 
direction signal indicative of direction of the user's field is 
of view; video camera means for producing a sequence 
of video signals which in combination are representative 
of a field of view thereof; camera mounting means for 
mounting said video camera means such that the field 
of view of the video camera means is substantially coin- 20 
cident with and follows movement of the field of view of 
the user; image generating means responsive to said 
direction signal for producing a correspondingly appro- 
priate computer-generated portion of the composite 
image; image selecting and combining means for ana- 25 
lyzing each of video signals and selecting video signals 
or computer-generated signals for producing the com- 
posite image signal and applying said composite image 
signals to said visual display means. 
[001 3] The system, however, fails to provide a possi- 30 
bility of presenting a virtual environment image to a user 
in response to changes in the user's real position and 
orientation in space. 

SUMMARY OF THE INVENTION 35 

[0014] It is an object of the present invention to pro- 
vide a method and a system for tracking and displaying 
a user's position and orientation in space, which ensure 
reduced manufacturing and operation costs with the 40 
simultaneous increase in accuracy and speed which are 
required for the adequate real-time display of the user's 
movements. 

[001 5] Another object of the invention is to provide a 
user with the possibility to naturally and unrestrictedly 45 
move in space and interact with the virtual environment 
objects in the process of tracking the user's movements. 
[0016] The other object of the invention is to improve 
accuracy and adequacy of presenting virtual environ- 
ment to a user in full conformity with changes in the so 
user's position and orientation in the process of his or 
her movements in real environment. 
[001 7] The aforementioned objects are accomplished 
in a method for tracking and displaying a user's position 
and orientation in space, said method including the ss 
steps of: 

a) attaching, proximate each of basic junctions of 



user's locomotor system segments, means for 
determining at least one angle between segments 
adjacent to a respective junction; 

b) locating reference direction determining means 
on at least one of the user's locomotor system seg- 
ments; 

c) determining an orientation of at least one seg- 
ment on which said reference direction determining 
means is located relative to said reference direc- 
tions; 

d) determining angles between the segments adja- 
cent to said basic junctions; 

e) determining a position and orientation in space 
of the user in general on the basis of the deter- 
mined angle values and an orientation of the at 
least one segment on which said reference direc- 
tion determining means is located. To obtain related 
sequences of data determining temporal changes 
in the user's position and orientation space in 
response to his or her real movements, the steps 
from (c) to (e) are repeated at predetermined inter- 
vals, and the obtained data of the user's position 
and orientation in space recorded for subsequent 
use. 

In addition, step (e) is accomplished using val- 
ues of linear dimensions of the user's locomotor 
system segments, and further includes the steps of: 

f) determining a bearing segment or segments of 
the user's locomotor system; 

g) positioning said bearing segment or segments 
relative to a support in the environment displayed. 

[0018] To obtain and record a sequence of data of the 
user's position and orientation in the displayed environ- 
ment and to display the user's movements in accord- 
ance with the obtained data, steps from (d) to (g) are 
repeated at predetermined intervals. 
[0019] The user's movements are displayed in real 
time or later, as needed, in accordance with the 
recorded data. 

[0020] The user's movements are preferably displayed 
in accordance with a required observation aspect or 
after additionally editing the obtained image of the 
user's movements. The reference directions are north- 
south directions of a geomagnetic field sensor and a 
direction of a local vertical sensor, or directions pro- 
duced by the geostabilized reference direction sensors, 
or north-south and west-east directions, or directions 
produced by an external source of reference directions. 
[0021] Furthermore, said reference direction deter- 
mining means is preferably at least one pair of spaced 
apart absolute coordinate sensors, said pair being dis- 
posed on at least one of the user's locomotor system 
segments. 

[0022] It is also preferable to specify linear dimensions 
of the user's locomotor system segments on the basis 
of known proportions of a human body, using data of the 
user's height, and the linear dimensions of the user's 
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locomotor system segments may be scaled for appro- 
priately altering the user's dimensions relative to the 
displayed environment. 

[0023] Additionally in the case of using a manipulator 
to provide user's interaction with objects of virtual envi- 5 
ronment, a position of the manipulator is preferably 
determined on the basis of a position of the user's hand 
holding the manipulator, while an accurate orientation of 
the manipulator is determined using supplementary ref- 
erence direction determining means disposed thereon, w 
[0024] The basic junctions between the user's loco- 
motor system segments are preferably selected from a 
hip joint, knee joints, mortis joints, shoulder joints, elbow 
joints, a junction between thoracic and lumbar spines 
and, additionally, foot joints and finger joints. 15 
[0025] The aforementioned objects are also accom- 
plished in a system for tracking a user's position and ori- 
entation in space, comprising a plurality of movement 
parameter sensors disposed on the user's body parts, 
converting means for converting sensor signals into a 20 
required presentation form, a measured data process- 
ing unit having an input coupled to an output of the con- 
verting means, and a user's position and in-space 
orientation display unit connected to the measured data 
processing unit, said system in accordance with the 25 
invention further comprising: reference direction deter- 
mining means disposed on at least one of user's loco- 
motor system segments, a polling unit having poll 
channels connected to the movement parameter sen- 
sors and the reference direction determining means, an 30 
output of the polling unit being connected to an input of 
the converting means, the movement parameter sen- 
sors being relative rotation angle sensors disposed in 
the immediate vicinity of the basic junctions between 
user's locomotor system segments or on the segments 35 
as such. 

[0026] The system for position and orientation track- 
ing comprises at least one means for user's interaction 
with virtual environment objects on which disposed is a 
supplementary reference direction determining means 40 
connected through a poll channel with the polling unit. 
[0027] It is also preferable that the relative rotation 
angle sensor is a fiber optics sensor or a strain gage. 
[0028] Additionally, the reference direction determin- 
ing means is based on a geomagnetic field sensor and 45 
a local vertical sensor, eg. a gravitation sensor or a 
gyro-stabilized reference direction sensor, or an artificial 
external source reference direction signal sensor. 
[0029] And finally, the system for position and orienta- 
tion tracking preferably comprises storage means for so 
storing the converted measured data for subsequently 
displaying the user's position and orientation in space, 
said storage means being connected through a data 
communication bus to the measured data processing 
unit; means for inputting optional data for constructing a ss 
mathematical simulation of a three-dimensional envi- 
ronment and a mathematical simulation of the user 
within it, connected to the measured data processing 



unit, and an image generating unit for generating an 
image at a required angle of view and editing the image, 
connected between an output of the measured data 
processing unit and an input the user's spatial position 
and orientation displaying unit. 

[0030] The aforementioned objects of the invention 
are also accomplished in a method for presenting virtual 
environment to a user in response to his or her move- 
ments in real environment, said method comprising the 
steps of: 

a) attaching, proximate each of basic junctions of 
user's locomotor system segments, means for 
determining at least one angle between segments 
adjacent to a respective junction; 

b) specifying linear dimensions of the user's loco- 
motor system segments; 

c) locating reference direction determining means 
on at least one of the user's locomotor system seg- 
ments; 

d) determining an orientation of the at least one 
segment on which said reference direction deter- 
mining means is disposed, relative to said refer- 
ence directions; 

e) determining angles between the segments adja- 
cent to said basic junctions; 

f) determining a position and orientation in space of 
the user in general on the basis of the obtained 
angle values and the orientation of the at least one 
segment on which said reference direction deter- 
mining means is disposed; 

g) determining a bearing segment or segments of 
the user's locomotor system; 

h) positioning said bearing segment or segments 
relative to a support in the virtual environment dis- 
played; 

i) determining a position and orientation of the 
user's head in virtual environment to determine the 
user s field of view in virtual environment; 

j) generating and presenting a virtual environment 
region corresponding to the users field of view to 
the user. 

[0031] The steps from d) to j) are repeated to display 
virtual environment changes in real time in response to 
the user's movements and interaction with virtual envi- 
ronment objects. 

[0032] Sequences of the user's position and orienta- 
tion data may be recorded for subsequent use. 
[0033] The reference directions are preferably north- 
south directions of a geomagnetic field sensor and a 
direction of a vertical sensor, or north-south and west- 
east directions, or directions produced by geo-stabilized 
reference direction sensors, or directions produced by 
an external source of reference directions, or directions 
produced by at least one pair of spaced apart absolute 
coordinate sensors, said pair being disposed on at least 
one of user's locomotor system segments. 
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[0034] It is also preferable to specify linear dimensions 
of the users locomotor system segments on the basis 
of known proportions of a human body, using data of the 
user's height and the linear dimensions of the user's 
locomotor system segments may be scaled for appro- 
priately altering the user's dimensions relative to the 
displayed environment. 

[0035] Additionally, in the case of employing a manip- 
ulator to provide the user's interaction with objects of vir- 
tual environment displayed, a position of the 
manipulator is preferably determined on the basis of a 
position of the user's hand holding the manipulator, 
while an accurate orientation of the manipulator is 
determined using a supplementary reference direction 
determining means disposed thereon. 
[0036] The basic junctions between the user's loco- 
motor system segments are preferably selected from a 
hip joint, knee joints, mortis joints, shoulder joints, elbow 
joints, wrist joints, junctions between head and shoul- 
ders and between thoracic and lumbar spines and, 
additionally, foot joints and finger joints. 
[0037] The aforementioned objects of the invention 
are also accomplished in a system for presenting virtual 
environment to a user moving in real environment, com- 
prising virtual environment image displaying means, 
means for producing a signal indicative of the direction 
of the user's field of view, means for producing a virtual 
environment image signal corresponding to the user's 
field of view, having an input connected to an output of 
the means for producing a signal indicative of the direc- 
tion of the user's field of view, and an output connected 
to an input of the virtual environment image displaying 
means, wherein in accordance with the invention, said 
means for producing a signal indicative of the direction 
of the user's field of view further comprises: means for 
determining at least one angle between user's locomo- 
tor system segments adjacent to an appropriate junc- 
tion of said segments; reference direction determining 
means disposed on at least one of the user's locomotor 
system segments; analogue-to-digit conversion means 
having inputs connected to outputs of said means for 
determining angles between the user's locomotor sys- 
tem segments and said reference direction determining 
means; a unit for constructing a simulation of a three- 
dimensional environment and the user within it, having 
an input connected to an output of said analogue-to- 
digit conversion means; and a user's field of view deter- 
mining unit having an input connected to an output of 
said unit for constructing a mathematical simulation of a 
three-dimensional environment and the user, and an 
output connected to an input of said means for produc- 
ing a virtual environment image signal conesponding to 
the user's field of view, a second input of said means for 
producing a virtual environment image signal corre- 
sponding to the user's field of view being connected to 
an output of the unit for constructing a mathematical 
simulation of a three-dimensional environment and the 
user within it. 



[0038] It is also preferable that the relative rotation 
angle sensor is a strain gage or a f toer optics sensor. 
[0039] Furthermore, the reference direction determin- 
ing means is preferably a geomagnetic field sensor and 
5 a local vertical sensor, or a gyro-stabilized reference 
direction sensor, or an external source reference direc- 
tion signal sensor. 

[0040] It is also preferable in the case of using a 
manipulator for user's interaction with objects of real or 

10 virtual environment displayed, to employ a supplemen- 
tary reference direction determining means disposed on 
the manipulator, an output of said supplementary refer- 
ence direction determining means being connected to 
an input of said analogue-to-digit conversion means. 

rs [0041 ] And finally, it is preferable to employ a long- 
term memory unit coupled to an output of said ana- 
logue-to-digit conversion means. 

Brief Description of the Drawings 

20 

[0042] The present invention will be apparent from the 
following description of its embodiments, taken in con- 
junction with the accompanying drawings in which 

25 Fig. 1 is a conventional view of a user, illustrating 
the arrangement of means for determining angles 
between user's locomotor system segments and 
reference direction determining means in the sys- 
tem in accordance with the present invention; 
30 Fig.2 is a general block diagram of a system for 
tracking and displaying the user's position and ori- 
entation, in accordance with the invention; 
Fig.3 is a general block diagram of the system for 
presenting virtual environment to a user moving in 
35 real environment, in accordance with the invention. 

Detailed Description of the Embodiments 

[0043] Schematically depicted in Fig. 1 is a user 1 

40 having a locomotor system consisting of segments 2 
with junctions 3. The junctions 3 of segments 2 simulate 
connections of bones with joints. The junctions, like 
human or animal joints, have a different degree of free- 
dom. For example, the connections of a forearm and a 

45 shoulder, a shank and thigh may be simulated as a sim- 
ple hinge joint with one degree of freedom, while the 
simulation of the connection of a shoulder with a shoul- 
der blade in the shoulder joint, and a hip joint will require 
a hinge joint with a great number of degrees of freedom. 

so [0044] Means for determining angles between the 
segments 2 are sensors 4 which track the position of the 
segments and their parts relative each other, the sen- 
sors being located on junctions 3 of the segments 2, 
and on the segments 2 as such. The sensors 4 serve for 

55 accurately tracking the user's movements, including 
measuring rotation angles of some segments relative 
their axes, for instance, of one end of the elbow seg- 
ment relative to the other end thereof The elbow seg- 
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f radiuses movab,e ««" respect to 
each other. which enables the rotation of oneSgmem 
end relative to the other one over its axis. There a^ev 
era. segments capable of rotating about their axes wX 
out changing an angle between the segment and an , 

szsm s T ent They are a head wit ^ ^ 

retative to shouWers; the thoracic part of the body rotat 
ng with respect to the pelvic part. The sensors 4 may be 
JJjr opt,cs sensors or strain gages. In one embcSnt 

**, d,a P'acement measuring sensor composed of a 
ransmm-ng section and a receiving section responlg 
o a var.at.on ,n the electromotive force induced in £e 

[0045] Reference direction determining means 5 is " 
disposed on one of the segments 2 anddes^ for 
determining a segment orientation with respect to^fS 
enced.rect.ons. Means 5 may be conveniently d Jpowd 

ui?£ * WhlCh ^ TOSt Stab,e at s "<* S * 
riJT?T entS 38 Wa ' kin9 and run ™9. It is recom 
mended to locate the means on the pelvic part. When 

heXn be ST * ^ a " 
^l^„r , qU ' CWy 3nd ^e^y tracked using a 
supplementery reference direction determining means 25 
secured on the head. In one embodiment, the reference 
225" t minin9 meanS ^ * ,oca ^ - Sja 
direclns or,entat, °^ respect to reference 

222 ri Mea "i. 6 for diSplayin9 virtual ^ronment to a " 
user .s d,sposed on the user's head in front of the user's 

ESLi Sh ,T in R9 2 ' an Pediment of a system 

T!f 65 3 PO, " n9 unit 7 which Eludes a master 
oSl W «t ^ i6S P0 " in9 rate " of the -"JIT 
means ?LZ " TV*"*™ di ^°n determining 
means 5. poll.ng rate k of optional devices 8 for interac 
to. «* virtual environment objects (manipulate^- „ 
sticks weapon simulators, etc.). Outputs of the ££, 

SLi^STT* t0 ana, ° 9ue - to ^ conv^sion 9 
fTom^ 1 * ° r cow *' anato 0ue data received 
from the sensors 4. the optional devices 8 and the rete? 
ence d.rection determining means 5 into £ date <s 
e.^hav.ng 8-byte v alue . An output of the ADC 9 is ot^- 

cells ,he number of which is not less than (n + m +k) %l 
*ri: " COUP ' ed - * *• P°»-9 unit 11 to a 

WT^iES"* ^ 12 ^ 3 data PW*" unit « 
13. The long-term memory unit 12 stores a time-varia- 
ble user's position and orientation data in response t0 
the user's actions for further employment fordSerert 

orTs'rt vb thiS °T 3,1 0UtPUt ° f * e 'ons-term m^m 
ory 12 may be coupled to an input of the data preoara- « 

tonunrtiSv^ichsmarthestheobtaineddatTSl 
accdental errors and represents the date in Tb form 
acceptable for constructing a user's mathematJs^ 
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memor unS m r^° d,ment ' an input * the ,0 "9-term 

MU the Tnr C ° nneCted 10 an in P ut of the A DC 
ac™ J h1? ,s accordi "9ly implemented. To take 
aS n ^ embodiments, the elements 7. 9, 10 

2 " t09ether may be refe «-ed to as an analogue-to 
digit conversion means. 

°T! ? ,he d3ta Potion unit 1 3 is cou- 
pled to an input of the unit 14 for constructing a mathe 
matical simulation of a three-dimensional en^onmen, 

ZZZtl ^ " t0 06 d " P ' ayed <° r -hich " p" 
sen ed to the user) and a mathematical simulation of the 
user there.n. Units 13 and 14 together may be refe 2 

means m Co^ nd **« data P™££ 

means. Connected to the unit 14 is an optional data 

JJP. it un, 15 which specifies an optiona, informal^ 

o2we?n ne l™™™"* temp0ral re,ati °^ 

Detween the user's movements and the dvnamirc „♦ 

changes in the displayed environment The nforma^n 
may .nclude such optional information of the ule^s his 

23? *, 9 ° f ^ reqUired ' user ' s ^he 
matical s.mulat.on is computed for an average human 

T ^ '°; u determin " 1 9 orientation of a basic segment 
22? » referenCe direCt '° n d6te ™ining meaTs "s 
7fo?lni ^ t0 me reference direc «°ns: a uS 

unit 18^t ^ 3 SimU ' ati0n ° f 106 user in 9enera.; a 
un t is ^ de term.n,ng a bearing segment (segments) 

m^-rl !L 6 """W-Benerated simulated environ 

S a "uSVnT ° f ^ 1 4 iS COnnected to ^ input 
of a unrt 20 for generating an image at the required 

2££ 3 "iSL*" diSP,ay,ng 3 P° si «°" «"d orient 

Zt Z™ *"* ^ P ° Siti0ned with res P e « to a sup- 
port in the environment displayed 

rOM9J Referring to Fig 3. a system for presenting vir- 
tual environment to a user moving in real environment 
comprises the same elements 4, 5. 7 to 19 as in F Tg 2 
S £ r ia,6S ° W 1,16 System de P icted *n Fig I , n 

a u?^^ dal r n,Wn B unrt ^ and an input of 
a un.t 23 for producing signals of a virtual environment 
image corresponding to the user's field of view. An ou t 
put of the unrt 22 is also coupled to the input of the v£ 
hial env,ronment image signal producing unit 23 Z 
output of the unit23is coupled to an input of the unit 2^ 

wh^hTofr 6 USef 3 ^ al -ironmentln 
wh.ch he or she .s immersed in response to the user's 
position and orientation therein 
[0050] A system for tracking and displaying a user's 
Pos*on and orientation, illustrated in Fig.2 ^at Js in 
the following manner. operates in 

P0O51] m a preferred embodiment, the sensors 4 and 

2S£t * SPeC ' al b0dy SUft ' Such as an ov erall or 
directly to the user at sites of the junctions 3 betwei 

the segments 2 and on the segments 2 as such Z 
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body suit with a set of the sensors 4 and the means 5 
should be light-weight, easily put on and off. and not 
restricting the user's movements. The sensors 4 are 
attached to the body suit so that when the user moves, 
i.e. the angles between the segments 2 vary or an end 
of a segment rotates with respect to the other end along 
the segment axis, some physical parameters change in 
the sensors. The physical parameters should change 
within predetermined ranges in response to the varia- 
tion in angles between adjacent segments 2 from one 
extreme position to the other one. 
[0052] The system may include a primary and supple- 
mentary reference direction determining means 5 to 
determine an angle between the segment on which an 
appropriate means 5 is located and the reference direc- 
tions. The primary reference direction determining 
means 5 is located on the segment which is taken as 
the basic segment. It is preferable to select the basic 
segment which is closer to the user's geometrical centre 
and the most stable at typical movements of a human, 
such as walking and running. These requirements are 
best met by the pelvic segment. When the user 
immerses in virtual reality, the use may be made of the 
supplementary reference direction determining means 
5 attached on the head to more accurately and quickly 
track tilts and turns of the head. 
[0053] Information from the sensors 4. the reference 
direction determining means 5 and optional devices 8 
for interaction with virtual environment objects is applied 
to the ADC and updated in response to a polling signal 
generated by the clock generator of the polling unit 7. 
From the ADC 9, the information is applied to corre- 
sponding memory cells in the storage unit 10. 
[0054] The polling unit 1 1 polls the memory cells in the 
storage unit 1 0 and produces a data sequence defining 
the user's position and orientation, including data from 
the optional devices 8 relating to a particular (present) 
point in time, and provides the data to the long-term 
memory unit 12 for long-term storage. The data may be 
employed at any moment, it is only necessary to feed 
the data to the data preparation unit 13 for subsequent 
processing. When used in real time, data from the poll- 
ing unit 1 1 is directly provided to the data preparation 
unit 13. The unit 13 smoothens the obtained data, 
deletes accidental errors, produces the required data 
sequence and presents the data in the required form to 
the unit 14 to construct a user's mathematical simula- 
tion. 

[0055] The unit 1 4 constructs a mathematical simula- 
tion of a three-dimensional environment in which the 
user is to be displayed, and a mathematical simulation 
of the user therein. Through the optional data inputting 
unit 15, an optional data of the user, the environment 
displayed, time relations between the user's movements 
and the dynamics of alterations in the environment dis- 
played is fed into the unit 14. This information may con- 
tain such optional information of the user, as his or her 
height weight, sex, age, etc. When the optional infor- 



mation is lacking or not required, the mathematical sim- 
ulation will be computed for an average human with 
standard proportions. If it is desired to produce the "Gul- 
liver** effect with unnaturally big or small objects in the 

5 environment displayed, the input data of the proportions 
between the linear dimensions of the environment and 
objects therein and the user's linear dimensions is mod- < 
rfied. In the same manner, a fast or slow time scale may 
be introduced into the environment displayed by chang- 

io ing the dynamics of the user s movements when enter- 
ing data from the long-term memory 12. If the users 
movement data is applied to the unit 13 in real time, the 
dynamics of the process flow in the displayed environ- 
ment may be accelerated or slowed down. 

75 [0056] The primary segment construction and orienta- 
tion unit 16 computes and constructs, based on the data 
received, a position and orientation of the basic seg- 
ment on which the primary reference direction deter- 
mining means is disposed with respect to reference 

20 directions. The reference directions are preferably the 
directions related with the Earth's geomagnetic field, 
north-south, west-east directions or a local vertical 
defined on the basis of the Earth's gravitational field and 
the north-south direction. These fields exist generally 

25 everywhere and are independent of the user. Using a 
special means like an electromagnetic compass and a 
horizontal or vertical gravitation sensor, an orientation of 
the user can be defined, and in particular, of that seg- 
ment of the user's locomotor system on which the 

30 means is secured. In the sites with a strong interference 
or the shielded Earth's magnetic field, an artificial field 
of reference directions may be generated by a dedi- 
cated means. It is vital to note that in this case it will be 
necessary only to define the user's orientation within 

35 this field without the need for determining an absolute 
distance to this means using triangulation algorithms 
that make having demand on computing power. 
[0057] The unit 1 7 for constructing a simulation of the 
user in general adds adjacent segments to the basic 

40 segments that have been constructed, using the modi- 
fied data of the angles between them, and further adds 
subsequent adjacent segments to the constructed adja- 
cent segments and so on up to the final segments. 
[0058] The unit 1 8 determines the user's bearing seg- 

45 ment or segments. By way of example, if the user is 
moving along a horizontal flat surface, a bearing seg- 
ment will be the lowermost one with respect to the local 
vertical, while a point of support will be the lowermost 
part of this segment. 

so [0059] The unit 1 9 positions the user relative the sup- 
port in the computer-generated environment. To this 
end, in the simplest case the user's simulation after 
being oriented is aligned with the user's support in the 
simulated environment so that to register a bearing por- 

55 tion of the user's bearing segment and a portion of the 
simulated environment which is the user's support at 
the present point in time. In the case the user is moving, 
e.g. jumping, i.e. "in flight" for a time, he or she is posi- 
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tioned relative to the support using the most recent 
.nformaton of the user's dynamics. It should be noted 
that having complete information of variation in the 
angles between the segments in dynamics, even the 
user s heart rate and a force with which he or she has , 
pushed away from the support may be computed. This 
w.ll allow the almost realistic simulation of the user's 
movements in the displayed environment. In do doing 
the changing user s position (coordinates) and the ori- 

t!^ n Z SPaCe 01 thS USer in 9 eneral are being w 
tracked .n dynam.cs in response to the varying position 
and mentation of the user's segments. That is to say 
from the d.splayed image of the user's movement it can 

tlrlT 6 ± th3t USer has made ten ^ps "on- 
ward, turned and ran southeast, and so on. 

[0060] From the output of the unit 14, the information 
of the constructed simulation of the user in the simu- 
teted environment is applied to the input of the unit 20 
for producing the image at a required angle of view 
wherem the viewer's point of view is selected, the user's so 
image at the required angle of view is computed, and if 
necessary, the image is edited for subsequent display. 
From the output of the unit 20. the information is pro- 
vided to the input of the unit 21 which displays the posi- 
tron and orientation of the simulated user positioned 25 
relaftve to the support in the displayed environment 
Us.ng the unit 20. the user himself or the outsiders may 
specify the aspect for viewing the dynamics of the user's 
movements. If desired, the user's movements can be 
viewed from above, from below, from the side, or from a 30 
changing point of view. In displaying the user's move- 
ments which have been previously written in the long- 
term memory, the movements may be edited before dis- 
playing in accordance with some task. By way of exam- 
ple,* is possible to simultaneously display movements 3s 
of the same user that were written in memory at differ- 
ent times, or to display movements of different users for 
comparison. Depending on the task set. the user's 
movements may be displayed as a simplified stylized 
simulation or in any other form more close to realistic to 
•mages with "rendering" complicated textures of 
clothes, skin, surrounding environment. In the former 
case, substantially any computer can cope with the 
task, wh.le in the latter case a relatively powerful com- 
puter w.th excellent graphic capabilities is required « 
[0061] When presenting virtual environment to a user 
the system m accordance with the invention operates in 
pr.nc.ple identically to that described with reference to 
Rg-2. The distinctive feature is that the unit 14 con- 
structs a three-dimensional simulation of the environ- so 

ZTJ^ lH t0 * e USer " and a mathematical 
simulation of the user therein. From the output of the 
unrt 14. the information of the constructed simulation of 
the user in the simulated environment is applied to an 
input of unit 22 for determining the user's field of view 55 

m^mTJ"^ ° f M 6 Unit 23 for producin 9 a envi- 
ronment image. Using the information received from the 
unrt 1 4. the unit 22 determines the user's field of view in 
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the virtual environment, i.e. which part of the virtual 

From the output of the unit 22. the user's angle of view 
information is provided to the unit 23 for producing the 
virtual environment image. In accordance with the 

ZVf ?2T the VirtUa ' ^onment -muta- 
tion, the unrt 23 produces an image of that part of the 

virtual environment which the user could see in accord- 
ance with his or her position and orientation in the vir- 
tual environment computed in response to the 

u^T in environment - F «>m the output of the 
unit 23. the s.gnals are applied to the input of the unit 24 
for present.ng the user with the virtual environment in 
which he or she is immersed, in response to his or her 
posrtion and orientation therein. The unit 24 may be any 
wrtual environment displaying means: a monitor, a vir 
tual helmet or goggles, including means 6 (Fig.1). 
IP062] As has been mentioned above in the state-of- 
the art description, the majority of conventional systems 
produce the user's simulation using absolute coordi- 
nates which are determined by the sensors located on 

ttVZZ ^ US> aP ° Siti0n iP SpaCe * tne userin general 
^autodetected. In dynamics, the absolute coordinates 
w,» g,ve a path of the user's movements. The environ- 
ment however. ,s most commonly restricted by the lim- 
its of external sensors or emitters located over the 
perimeter of an active region of the user's actions The 
invention, in contrast, does not substantially restrict the 
active region of user's movements, as all that is needed 

%r*T m T 9 the USSr ' S O 05 *™ *« option is 
located on the user himself. It is only important to pro- 
vide an operation field for the reference direction deter- 
mining means, while the user s movements in space are 
computed by a computer in accordance with the infor- 
mation of changing the angles between the segments 
SiE!„f^ or,entation wrth aspect to the reference 
n S «, ^ ngeS the envir °r>ment may be com- 
puted on the basis of a number, dimension and direction 
of the users steps. To determine the step dimension 
the angles between and the linear dimensions of the 

SHifT? i e9memS 31 me inStant * Pe^rming the 
step should be known. More particularly, to determine a 
human s step it is necessary to know the angle between 

^ nes of the left and right ,e9s ' the ™& 

between the femoral bone and the shank of each leg 
and the shank and thigh linear dimensions. In some 
cases it will be also useful to measure the angles 
between the foot and the shank, and between the foot 
and toes. 

[0063] To simplify the criterion of determining bearing 
segments through the segment orientations with 

I!f 3 P !f ne> thS USe may be made of the sensors 
mounted on the user's sole. For example, if a leg is a 

1™ ^ H in tirne - a contact closes in 

n„T l and ' ,the 169 is ,ifted and han 9s. *e contact 
on the contrary, opens. The sensor may also provide the 
informabon of the load carried by each leg. Based on 
the load carried by the leg in dynamics and the users 



BNSDOCID: <EP 0959444Ai_L> 



8 



15 

weight, the impetus obtained by the user and the path of 
the user's movement may be computed even for a jump. 
The data required for computing the movement path 
and physical characteristics of the user's movements 
can be also computed on the basis of the dynamics of 5 
changing the angles between the segments. 

Industrial Applicability 

[0064] A method and a system in accordance with the 10 
present invention provide a variety of entirely new pos- 
sibilities which have been infeasible hitherto, in particu- 
lar, an opportunity of conducting tests and competitions 
involving various movements, such as athletic and 
dancing, and for assessing the adequacy of responding is 
to a proposed situation and in combats. The competi- 
tions could be conducted separated in time, for exam- 
ple, by taking data from the same user at different times. 
The data may be then assessed and compared both by 
a computer and by a human after viewing the move- 20 
ments for comparison. The competitions may be simul- 
taneously conducted among a plurality of users. To this 
end, data is taken in real time from several users and 
used to compare the correctness of performing and 
responding to a situation, the response speed and the 25 
originality of movements. Such competitions may be 
conducted between the invented system users which 
are connected to the Internet or a dedicated network, 
while the users may be separated by a considerable dis- 
tance. 30 
[0065] The user's position and orientation data written 
in memory may be further archived. It is possible to gen- 
erate libraries of typical movements of a human or any 
chordates and unique movements written from promi- 
nent sportsmen and dancers. 35 
[0066] One of the basic advantages of the present 
invention is that the entire system of sensors is on a 
user. There is no necessity to determine absolute dis- 
tances to reference points which are defined as the 
external sensor positions in the prior art systems. The 40 
invention ensures the determination of a user's position 
and orientation substantially in an unbounded environ- 
ment having only a field of reference directions with 
respect to which the user may be oriented. Determina- 
tion of reference directions anticipates, as described 45 
above, the determination of orientation of a segment on 
which reference direction determining means is located 
with respect to the reference directions. The most con- 
venient reference directions are vector directions of the 
Earth's natural fields existing substantially everywhere so 
irrespective of us. The two reference directions sug- 
gested (the third one being constructed orthogonally to 
the previous two) are the north-south and west-east 
directions of the Earth's magnetic field, or e.g. the north- 
south cfi recti on and a local vertical defined by the 55 
Earth's gravitation field. If a user is in a room which is 
shielded from external fields, the use may be made of 
reference direction artificial field emitters. In this case, 
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as previously, it is necessary to determine the user's ori- 
entation in the reference cfi recti on field, rather than 
absolute distances to the external emitters. In this case 
determined are the angles between the vector of the 
segment on which the reference direction determining 
means is located, and the reference directions. 
[0067] By tracking a user's position and orientation 
and presenting virtual environment to the user in 
accordance with the invention, nearly almost all 
attributes of a "time machine" within the scope of the 
logged history of the user's actions may be imple- 
mented when immersing in virtual reality. The user may 
return to any point in time within his or her history at any 
instant of his or her logged actions or another hero's 
actions. This may be used in computer games so that a 
player could return and change his or her behavior for a 
more effective one. Taking into account that several par- 
allel behavior lines may be written, the user may select 
any behavior line which is the most effective in his or her 
opinion, to continue his or her actions. Through the use 
of the logged user's position and orientation changes in 
dynamics, it is possible to realize a four-dimensional 
environment which is defined by three spatial dimen- 
sions and time. Unlike the movements in real life where 
a movement in time is accomplished in a sole direction 
only, towards the future, the invention allows, using the 
stored data, a continuous or discrete movement to be 
accomplished towards different sides in time within the 
scope of data written in memory, as easily as in space. 
[0068] Owing to the fact that the present invention 
tracks the user's movements and presents virtual envi- 
ronment without resorting to sophisticated external 
devices, the capabilities of existing computer systems 
can be extended and new fields of application can be 
found. A standard description of user's movements 
tracked may be produced for the employment in differ- 
ent systems. Such standard description of user's move- 
ments may be used, for example, as part of VRML 
(Virtual Reality Modeling Language), in animation and 
for generation of dedicated libraries. The majority of 
future computer applications could use the standards 
taking into account the possibility of controlling the pro- 
gram using the user s natural movements which are 
tracked by a method in accordance with the present 
invention. To provide the possibility of using the entire 
park of current computer applications in which the 
user's movements are realized by a keyboard, a mouse 
or a joystick, with the system in accordance with the 
present invention, it is necessary to provide interfacing 
drivers, i.e. programs which would recognize user's 
movements and convert them into game control signals 
and similar movement simulation signals. 
[0069] One of the most important applications of the 
present invention relates to training a user how to per- 
form some model movements, such as dancing, athletic 
or professional movements or the movements for 
improving hearth. To this end, model movements are 
displayed to a user. To attain the best result, the trainee 
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should be provided with the possibility to retry, to select 
any aspect, dynamics of performing, and a scale. After 
that the user should endeavor to repeat the movements 
as correctly as possible. For the subsequent control, his 
or her movements should be stored, logged, so that to 5 
compare them with the model movements. The compar- 
ison of the model movements with the user's move- 
ments can be accomplished by different methods. The 
user himself may view the simultaneously displayed 
model movements and previously stored user's move- 10 
ments. A more interesting and promising possibility is 
the assessment of correctness of the user's movement 
by a computer or a skilled person. In accordance with a 
program downloaded, a computer can produce com- 
ments and recommendations after the comparison of 15 
the user's movements tracked through the user's posi- 
tion and orientation. The user will correct his or her 
movements until, a required skill and accuracy are 
achieved. This process is like training by a master, 
although it does not involve corresponding expenditures 2 o 
and the schedule approval by the master. The feedback 
program generated by the best masters can be repli- 
cated in millions of copies, and everyone may resort to 
it at any convenient time. 

[0070] The present invention can be also used to 25 
monitor the measured physical loads on a user. By way 
of example, a load is defined for a particular person in 
accordance with recommendations of a physician or a 
trainer. In the absence of such individual recommenda- 
tions or general contraindications, a computer can com- 30 
pute and recommend the system of loads for some 
period of time. To define the loads, the use can be made 
of data of past and chronic diseases, weight, height, 
sex, age, training purpose, degree of exercise and emo- 
tional stresses during a day. Dedicated preliminary tests 35 
may be conducted which involve monitoring the body 
response, for example, the degree of changing heart 
rate under dosed stresses. 

[0071 ] After determining the loads, the computer may 
generate optimum recommendations for a definite time. 40 
The user will get to his or her training using the system 
of sensors which most completely track the user's 
movements so that data of loads on separate body 
parts can easily computed based on the information of 
movements. In such training, it would be useful to 45 
employ data from the user's heart rate sensors, and, if 
appropriate, the other physiological characteristics. 
[0072] rf a user is immersed in virtual environment and 
uses a training apparatus which allows the movements 
to be performed unrestrictedly, the user's exercise and so 
emotional stress can be controlled by a downloaded 
program through changing the story dynamics and the 
environment surrounding the user. In a game, the con- 
trol may be accomplished through dosing a number of 
appearing enemies, the story intensity, the necessity to ss 
chase the enemy at a sufficient speed or to escape from 
dangerous places. Unnoticeable for the user, such con- 
trol allows, for example, the heart rate to be maintained 



within a predetermined range for a specified time 
period. After the desired stress has been reached, the 
user should be brought to performing the task and com- 
pleting the story. This would allow him or her to finish 
the training in the emotionally excited mood from the 
result achieved. Currently existing games, unfortu- 
nately, fail to satisfy these principles. A player is mostly 
motionless, i.e. there is zero exercise stress at a high 
emotional stress which may lead to strains and depres- 
sions. Performed at the controlled exercise and emo- 
tional stresses, games and exercises can be excellent 
means against hypodynamia and nervous overstrains, 
and to promote the all-round harmonic habilitation of a 
person. 

[0073] The exercises with predetermined physical 
loads, accompanied by cognitive or entertaining infor- 
mation, may be accomplished through the immersion 
into a particular, user-selected virtual environment. As 
an example, a computer program may simulate a run- 
ning excursion over prominent places with a guide 
which would tell of places of interest and set the tempo 
of a walking or running excursion at a predetermined 
speed or at a speed variable of necessity. The excursion 
may be brought to an end after a predetermined load 
has been attained. As the exercises are individual, data 
of previous exercises and loads may be written in the 
computer memory for subsequent modification of loads 
from an initial level to a level which is recommended as 
stable. Normal constant or daily variable stresses may 
be emotionally colored and accompanied by a new use- 
ful information. For better emotional coloring, a possibil- 
ity may be provided to select the guide's sex or age, or 
to simulate the image of a prominent actor or politician. 
[0074] If the user employing the sensor system gets a 
load without the immersion in virtual reality, the loads 
may be controlled by a processor, the feedback being 
provided through headphones via the auditory channel. 
The processor may report of the necessity to change 
the general tempo of a load or loads on separate body 
parts. The decisions can be taken on the basis of the 
information received from the system for tracking a 
user's position and orientation in accordance with a load 
computation program. 

Claims 

1 . A method for tracking and displaying a user's posi- 
tion and orientation in space, including determining 
parameters of displacements of users body parts, 
converting the obtained measurement data into a 
required presentation form and processing a set of 
the converted data to produce data defining the 
user's position and orientation in space, said 
method characterized by the steps of: 

a) attaching, proximate each of basic junctions 
of user's locomotor system segments, means 
for determining at least one angle between 
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segments adjacent to a respective junction; 

b) locating reference direction determining 
means on at least one of the user's locomotor 
system segments; 

c) determining an orientation of the at least one s 
segment on which said reference direction 
determining means is located with respect to 
said reference directions; 

d) determining angles between the segments 
adjacent to said basic junctions; w 

e) determining a position and orientation in 
space of the user in general on the basis of 
determined angle values and the orientation of 
the at least one segment on which the refer- 
ence direction determining means is located. 15 

2. A method of claim 1 , wherein said steps from (c) to 
(e) are repeated at predetermined intervals to 
obtain related sequences of data determining tem- 
poral changes in the user's position and orientation 20 
in space in response to the user's real movements,. 



3. A method of claim 2, wherein the obtained data of 
the user's position and orientation in space is 
recorded for subsequent use. 25 

4. A method of claim 1, wherein said step (e) is 
accomplished using values of linear dimensions of 
the user's locomotor system segments, and further 
includes the steps of: 30 

f) determining a bearing segment or segments 
of the user's locomotor system; 

g) positioning said bearing segment or seg- 
ments relative to a support in an environment 35 
displayed. 

5. A method of claim 4, wherein said steps from (d) to 
(g) are repeated at predetermined intervals to 
obtain and record a sequence of data of the user's 40 
position and orientation in the displayed environ- 
ment and to display the user's movements in 
accordance with the obtained data. 

6. A method of claim 5, wherein the user's movements 45 
are displayed in real time. 

7. A method of claim 5, wherein the user's movements 
are displayed later, as needed, in accordance with 
the recorded data. so 



ments. 

10. A method of any of preceding claims, wherein said 
reference directions are north-south directions of a 
geomagnetic field sensor and directions of a local 
vertical sensor. 

11. A method of any of claims 1 to 9, wherein said ref- 
erence directions are north-south or west-east 
directions of a geomagnetic field sensor. 

12. A method of any of claims 1 to 9, wherein said ref- 
erence directions are directions produced by 
geostabtlized reference direction sensors. 

13. A method of any of claims 1 to 9, wherein said ref- 
erence directions are directions produced by an 
external source of reference directions. 

14. A method of any of claims 1 to 9, wherein said ref- 
erence direction determining means is at least one 
pair of spaced apart absolute coordinate sensors, 
said pair being disposed on at least one of the 
user's locomotor system segments. 

15. A method of any of claims 4 to 14, wherein said lin- 
ear dimensions of the user's locomotor system seg- 
ments are specified on the basis of known 
proportions of a human body, using data of the 
user's height 

16. A method of any of claims 4 to 15, wherein said lin- 
ear dimensions of the user's locomotor system seg- 
ments are scaled for appropriately altering the 
user's dimensions relative to the displayed environ- 
ment. 

17. A method of any of claims 4 to 16, wherein, in the 
case of employing a manipulator to provide user s 
interaction with virtual environment objects, a posi- 
tion of the manipulator is determined on the basis of 
a position of the user's hand holding the manipula- 
tor, while an accurate orientation of the manipulator 
is determined using supplementary reference 
direction determining means disposed on the 
manipulator. 

18. A method of any of preceding claims, wherein said 
basic junctions between the user s locomotor sys- 
tem segments are preferably selected from a hip 
joint, knee joints, mortis joints, shoulder joints, 
elbow joints, wrist joints, and a spine junction. 

19. A method of claim 18. wherein said basic junctions 
are also foot joints and finger joints. 

20. A system for tracking a user's position and orienta- 
tion in space, comprising a plurality of movement 



8. A method of claim 6 or 7, wherein the user's move- 
ments are displayed in accordance with a required 
observation aspect. 

9. A method of claim 6 or 7, further comprising editing 
the generated image of the user's movements and 
displaying the edited image of the user's move- 
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parameter sensors disposed on users body parts, 
converting means for converting sensor signals into 
a required presentation form, a measured data 
processing unit having an input coupled to an out- 
put of the converting means, and a user's spatial 5 
position and orientation displaying unit connected 
to the measured data processing unit, character- 
ized in that said system further comprises: 

reference direction determining means dis- w 
posed on at least one of user's locomotor sys- 
tem segments; 

a polling unit having poll channels connected to 
the movement parameter sensors and the ref- 
erence direction determining means, an output is 
of the polling unit being connected to an input 
of the converting means, the movement param- 
eter sensors being relative rotation angle sen- 
sors disposed in the immediate vicinity of the 
basic junctions between user's locomotor sys- so 
tern segments or on the segments as such. 

21. A system of claim 20, further comprising at least 
one means for user's interaction with virtual envi- 
ronment objects, on which disposed is a supple- 25 
mentary reference direction determining means 
connected through a poll channel with the polling 
unit. 

22. A system of claim 20 or 21, wherein said relative so 
rotation angle sensor is a strain gage. 

23. A system of claim 20 or 21, wherein said relative 
rotation angle sensor is a fiber optics sensor. 

24. A system of any of claims 20 to 23, wherein said 
reference direction determining means comprises a 
geomagnetic field sensor. 

25. A system of daim 24, wherein said reference direc- 
tion determining means further comprises a local 
vertical sensor. 
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26. A system of claim 25, wherein said local vertical 
sensor is a gravitation sensor. ^ 

27. A system of any of claims 20 to 23, wherein said 
reference direction determining means comprises 
an artificial external source reference direction sig- 
nal sensor. 

50 

28. A system of any of claims 20 to 27, further compris- 
ing storage means for storing the converted meas- 
ured data for subsequently displaying the user's 
position and orientation in space, said storage 55 
means being connected through a data communi- 
cation bus to the measured data processing unit. 



29. A system of any of claims 20 to 28, further compris- 
ing means for inputting optional data for construct- 
ing a mathematical simulation of a three- 
dimensional environment and a mathematical sim- 
ulation of the user displayed therein, said optional 
data inputting means being connected to the meas- 
ured data processing unit. 

30. A system of any of claims 20 to 29, further compris- 
ing an image generating unit for generating an 
image at a required angle of view and editing the 
image, having an input connected to an output of 
the measured data processing unit, and an output 
connected to an input the user's spatial position 
and orientation displaying unit. 

31. A method for presenting virtual environment to a 
user in response to user's movements in real envi- 
ronment, including determining parameters of dis- 
placements of user's body parts, converting the 
obtained data into a required presentation form and 
processing a set of the converted data to determine 
a virtual environment region to be displayed to the 
user in response to user's position and orientation, 
taking into account user's interaction with virtual 
environment objects, said method characterized by 
the steps of: 

a) attaching, proximate each of basic junctions 
of user's locomotor system segments, means 
for determining at least one angle between 
segments adjacent to a respective junction; 

b) specifying linear dimensions of the user's 
locomotor system segments; 

c) locating reference direction determining 
means on at least one of the user's locomotor 
system segments; 

d) determining an orientation of the at least one 
segment on which said reference direction 
determining means is disposed relative to said 
reference directions; 

e) determining angles between segments adja- 
cent to said basic junctions; 

f) determining a position and orientation in 
space of the user in general on the basis of the 
obtained angle values and the orientation of 
the at least one segment on which said refer- 
ence direction determining means is disposed; 

g) determining a bearing segment or segments 
of the user's locomotor system; 

h) positioning said bearing segment or seg- 
ments relative to a support in the virtual envi- 
ronment displayed; 

i) determining a position and orientation of the 
user's head in the virtual environment to deter- 
mine the user's field of view in the virtual envi- 
ronment; 

j) generating and presenting a virtual environ- 
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ment region corresponding to the user's field of 
view to the user. 

32. A method of claim 31 , wherein said steps from d) to 
j) are repeated to display virtual environment 
changes in real time in response to the user's 
movements and interaction with virtual environment 
objects. 

33. A method of claim 31, wherein sequences of the 
user s position and orientation data are recorded for 
subsequent use. 

34. A method of any of claims 31 to 33, wherein said 
reference directions are north-south directions of a 
geomagnetic field sensor and a direction of a local 
vertical sensor. 

35. A method of any of claims 31 to 33. wherein said 
reference directions are north-south or west-east 
directions of a geomagnetic field sensor. 

36. A method of any of claims 31 to 33, wherein said 
reference directions are directions produced by 
geostabilized reference direction sensors. 

37. A method of any of claims 31 to 33. wherein said 
reference directions are directions produced by an 
external source of reference directions. 

38. A method of any of claims 31 to 33, wherein said 
reference direction determining means is at least 
one pair of spaced apart absolute coordinate sen- 
sors, said pair being disposed on at least one of the 
user's locomotor system segments. 

39. A method of any of claims 31 to 38, wherein said 
linear dimensions of the user's locomotor system 
segments are specified on the basis of known pro- 
portions of a human body, using data of the user's 
height. 

40. A method of any of claims 31 to 39, wherein said 
linear dimensions of the user's locomotor system 
segments are scaled for appropriately altering the 
user's dimensions relative to the displayed environ- 
ment. 

41. A method of any of claims 31 to 40, wherein in the 
case of using a manipulator to provide user's inter- 
action with virtual environment objects, a position of 
the manipulator is determined on the basis of a 
position of the user's hand holding the manipulator, 
while an accurate orientation of the manipulator is 
determined using supplementary reference direc- 
tion determining means disposed on the manipula- 
tor. 



42. A method of any of claims 31 to 41, wherein said 
basic junctions between the user s locomotor sys- 
tem segments are selected from a hip joint, knee 
joints, mortis joints, shoulder joints, elbow joints. 

5 wrist joints, and junctions between head and shoul- 

ders, and between thoracic and lumbar spines. 

43. A method of claim 42. wherein said basic junctions 
are also foot joints and finger joints. 

10 

44. A system for presenting virtual environment to a 
user moving in real environment, comprising virtual 
environment image displaying means, means for 
producing a signal indicative of the direction of the 

75 user's field of view, means for producing a signal of 
a virtual environment image corresponding to the 
user's field of view, having an input connected to an 
output of said means for producing a signal indica- 
tive of the direction of the user's field of view, and an 

20 output connected to an input of the virtual environ- 
ment image displaying means, said system charac- 
terized in that said means for producing a signal 
indicative of the direction of the user s field of view 
further comprises: 

25 

means for determining at least one angle 
between user's locomotor system segments 
adjacent to an appropriate junction of said seg- 
ments; 

30 reference direction determining means dis- 

posed on at least one of the user's locomotor 
system segments; 

analogue-to-digit conversion means having 
inputs connected to outputs of said means for 

35 determining angles between the user's loco- 

motor system segments and said reference 
direction determining means; 
a unit for constructing a simulation of a three- 
dimensional environment and the user within it, 

40 having an input connected to an output of said 

analogue-to-digit conversion means; and 
a user's field of view determining unit having an 
input connected to an output of said unit for 
constructing a mathematical simulation of a 

45 three-dimensional environment and the user, 

and an output connected to an input of said 
means for producing virtual environment image 
signals. 

so 45. A system of claim 44, wherein said relative rotation 
angle sensor is a strain gage. 

46. A system of claim 44. wherein said relative rotation 
angle sensor is a fiber optics sensor. 

55 

47. A system of any of claims 44 to 46, wherein said 
reference direction determining means is a geo- 
magnetic field sensor and a local vertical sensor. 
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48. A system of claim 47, wherein said local vertical 
sensor is a gravitation sensor. 

49. A system of any of claims 44 to 46, wherein said 
reference direction determining means is a gyro- s 
stabilized reference direction sensor. 

50. A system of any of claims 44 to 46. wherein said 

reference direction determining means comprises 

an external source reference direction signal sen- w 
sor. 

51. A system of any of claims 44 to 50, wherein in the 
case of using a manipulator for user s interaction 
with objects of real or virtual environment dis- 75 
played, the use is made of a supplementary refer- 
ence direction determining means disposed on the 
manipulator, an output of said supplementary refer- 
ence direction determining means being connected 

to a respective input of said analogue-to-digit con- 20 
version means. 

52. A system of any of claims 44 to 51 , further compris- 
ing a long-term memory unit having an input con- 
nected to an output of said analogue-to-digit 25 
conversion means. 
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